Stereoscopic image generation method and apparatus thereof

ABSTRACT

The transform arithmetic operations by spatial image transform matrixes and perspective transform matrixes to a screen surface thereon are executed on source video signal representing two-dimensional image so as to generate left-eye and right-eye video signals. It is possible to realize the stereoscopic image generation apparatus capable of setting the visual difference between a left eye and a right eye easily.

TECHNICAL FIELD

The present invention relates to a stereoscopic image generation methodand apparatus thereof, which particularly will generate a stereoscopicimage that the operator can perceive in a virtual space based on thevideo signal representing two-dimensional image.

BACKGROUND ART

Hitherto, a stereoscopic image display apparatus as shown in FIG. 1 isproposed as a stereoscopic image generation apparatus which enables theoperator to appreciate stereoscopic images.

The stereoscopic image display apparatus 1 is constructed so as toproject left-eye projecting light and right-eye projecting light from aleft-eye projector 2L and a right-eye projector 2R through each read,green, and blue three primary color polarized filters 3LR, 3LG, 3LB, and3RR, 3RG, 3RB on a screen 4 to display color composite image on thescreen 4, so that the operator can see the color composite image throughglasses 5 having a left-eye filter 5L and a right-eye filter 5R.

In this case, the operator sees the left-eye image out of the colorcomposite image projected from the left-eye projector 2L through theleft-eye filter 5L, and also sees the right-eye image projected from theright-eye projector 2R through the right-eye filter 5R. As a result, asshown in FIGS. 2(A) to 2(C), the operator perceives the color compositeimage on the screen 4 as a stereoscopic image based on visual differencebetween a left eye 6L and a right eye 6R.

Incidentally, as shown in FIG. 2(A), when a left-eye image 7L projectedfrom the left-eye projector 2L and a right-eye image 7R projected fromthe right-eye projector 2R are displayed on the same position on thescreen 4, 8L, the operator's left eye 6L, is crossed with 8R, theoperator's right eye 6R, at the same point on the screen 4, so that theoperator recognizes as if "there is a composite stereoscopic image onthe screen 4."

On the contrary, as shown in FIG. 2(B), when the left-eye image 7L andthe right-eye image 7R are displayed shifting with each other at theposition opposite to the left eye 6L and the right eye 6R on the screen4, a virtual image 9B is imaged at the point in the virtual space (it isgenerated backward than the screen 4) in which the operator's eye BLseeing the left-eye image 7L by the his/her left eye 6L and theoperator's eye 8R seeing the right-eye image 7R by the his/her right eye6R are crossed. This makes the operator to recognize as if "there is acomposite stereoscopic image backward the screen 4."

Further, as shown in FIG. 2(C), when the right-eye image 7R and theleft-eye image 7L are projected at the position on the screen 4 oppositeto the left eye 6L and the right eye 6R, the operator's eye 8L seeingthe left-eye image 7L by the left eye 6L and the operator's eye 8Rseeing the right-eye image 7R by the right eye 6R are crossed at theforward position than the screen 4 in the virtual space, and a virtualimage 9F is imaged. This makes the operator recognize as if "there is acomposite stereoscopic image in front of the screen 4."

Consequently, since the projecting points of the left-eye image 7L andthe right-eye image 7R on the screen 4 can be shifted by the distancecorresponding to the visual difference between the left eye 6L and theright eye 6R, the operator can appreciate the composite stereoscopicimage as if it were displayed at the position of the screen 4, orbackward or front in the screen 4.

When generating a stereoscopic image by way of such method, however, itis very difficult actually to decide the projecting positions of theleft-eye image 7L and the right-eye image 7R projected from the left-eyeprojector 2L and the right-eye projector 2R, which requires the operatorwell enough skill.

Incidentally, visual difference between the left eye 6L and the righteye 6R is actually not so large (3.25 cm! and the like), so that actualgeneration of effective stereoscopic image requires the complicatedsetting operation that the skilled operator sets the projecting point ofthe left-eye image 7L and the right-eye image 7R by changing with trialsand errors.

DISCLOSURE OF THE INVENTION

The present invention has been made in view of the aforementioned pointsand proposes a stereoscopic image generation method and apparatusthereof which is capable of easily displaying the composite stereoscopicimage of the left-eye image and the right-eye image at desirableposition on the screen as needed.

To solve the aforementioned problems, in the present invention,processes source video signal with the image transform process by way ofleft-eye image transform process means and right-eye image transformprocess means, so that the left-eye image and the right-eye image can begenerated at the desired position on the screen corresponding to thevisual difference.

In order to obtain the left-eye image, the image transform arithmeticoperation for generating left-eye stereoscopic video signal from thesource video signal is executed based on a spatial image transformmatrix for converting the image represented by the source video signalto a virtual spatial position and a left-eye perspective transformmatrix for having a converted image represented by a transform videosignal converted to the virtual spatial position seen through. Further,in order to obtain the right-eye image, the image transform arithmeticoperation for generating right-eye stereoscopic video signal from thesource video signal is executed based on the spatial image transformmatrix and a right-eye perspective transform matrix for having aconverted image represented by a transform video signal seen through.

Thus, according to the present invention, the left-eye and right-eyeimages can have the appropriate visual difference between each other bythe parameter that the operator inputs based on the input video signalshowing a two-dimensional image, so that it is possible to generate astereoscopic image having much finer picture quality.

Further, according to the present invention, when the operator processesthe desired three-dimensional process to the two-dimensional sourcevideo signal, use of the spatial transform matrix and the left-eyeperspective transform matrix and the right-eye perspective transformmatrix can generate a left-eye and right-eye two-dimensional videosignals having appropriate visual difference with each other easily byarithmetic operation based on the spatial position of the convertedsource video signal.

Further, the source video signal is moved continuously by frames in thethree-dimensional space based on the operator's operation, the right-eyevideo signal and the left-eye video signal in real time interlockingwith the continuous movement of the source video signal.

Further, the simultaneous image transform process based on one inputvideo signal at the time of generating the left-eye and right-eye imagesremoves such complicated process as re-synchronization of the left-eyeand right-eye images, which makes it possible to generate much betterstereoscopic image. Accordingly, it is possible to display the left-eyevideo signal and the right-eye video signal synchronizing with eachother all the time on the screen.

BRIEF DESCRIPTION OF THE DRAWING

FIG. 1 is a perspective view showing a stereoscopic image displayapparatus to which the present invention can be applied.

FIGS. 2(A) to 2(C) are schematic diagrams explaining that the operatorcan perceive a stereoscopic image according to the structure of FIG. 1.

FIG. 3 is a schematic diagram explaining the left-eye and right-eyeimages to be generated by the present invention.

FIGS. 4(A1) to (B2) are schematic diagrams explaining the movementprinciple of the stereoscopic image generation apparatus and methodthereof according to the present invention.

FIG. 5 is a schematic diagram explaining the image transform processbetween positional vector on a frame memory and positional vector on thescreen.

FIG. 6 is a block diagram showing the first embodiment of thestereoscopic image generation apparatus according to the presentinvention.

FIG. 7 is a block diagram showing the second embodiment of thestereoscopic image generation apparatus according to the presentinvention.

FIGS. 8(A) and 8(B) are schematic diagrams explaining the operation ofFIG. 7.

BEST MODE FOR CARRYING OUT THE INVENTION

Referring to the drawings, one embodiment of the present invention willbe described in detail.

(1) Generation Principle of the Stereoscopic Image

A method of generating a stereoscopic image according to the presentinvention is as follows. As shown in FIG. 3, in xyz-virtual spaceincluding a screen 11, an image transform arithmetic operation isexecuted so as to obtain left-eye and right-eye images 14L and 14R inwhich the image of an object 13 is seen through on a screen 11 along thedirections of left and right eyes 12L and 12R when the left eye 12L andthe right eye 12R see the object 13, a composite stereoscopic imagehaving depth, at an arbitrary position.

Here, the depth means the information representing the position in thedirection along the centerline passing between the left eye 12L and theright eye 12R both watching the object 13.

As shown in FIG. 4(A1), an image V1 shown by an input video signal as asource video signal (referred to as an object) is set as the imagedisplayed at the origin of xy-plane on the display screen of the screen11 on x- and y-axes.

The object V1, the image of the input video signal input as the sourcevideo signal, is processed a parallel movement arithmetic operation anda rotary arithmetic operation by a three-dimensional image transformmatrix T₀ represented by the following equation: ##EQU1## so as to beconverted to an intermediate transform image V2.

The transform process according to the three-dimensional image transformmatrix T₀ executes the image transform arithmetic operation on the inputvideo signal with the spatial image transform matrix T₀, which makes theimage of the object V1 represented by the input video signal move inparallel in the depth direction from the position on the x-y plane alongz-axis on the screen 11 and rotate. As a result, the input video signalconverted to the converted image having the depth information atbackward position of the screen 11.

The intermediate transform image V2 is converted for the image transformrepresenting visual difference from the left eye 12L by +Δx movementmatrix L represented by the following equation: ##EQU2##

Consequently, an intermediate transform image V3L is obtained.

The +Δx movement matrix L means execution of the transform arithmeticoperation which moves the intermediate transform image V2 in thedirection along x-axis in parallel by the distance of +Δx. The left eye12L is therefore assumed to be on z-axis and in the condition of seeingthe intermediate transform image V3L from its position 12LX.

Next, the intermediate transform image VL3 is converted by using asee-through matrix P₀ represented by the following equation: ##EQU3##

As a result, an intermediate transform image V4L is obtained on thescreen 11 on x- and y-axes.

The process by the see-through matrix P₀ means that, when theintermediate transform image V3L is in the direction from the position12LX of the left eye 12L, the intermediate transform image V4L can beseen by having the see-through image of the intermediate transform imageV3L seen through on the screen 11.

Next, the intermediate transform image V4L is converted by -Δx movementmatrix L⁻¹ represented by the following equation: ##EQU4##

As a result, it is converted to a final transform image V5L.

-Δx movement matrix L⁻¹ moves the intermediate image V4L in thedirection of x-axis in parallel by the distance of -Δx. Assuming z-axisto be the center between the left eye 12L and the right eye 12R, theposition of the left eye 12L is moved by Δx from the center to left, sothat the final transform image V5L is obtained as the see-through imageon the screen 11 (FIG. 4(B1)) when the left eye 12L sees theintermediate transform image V2 from the original position.

Since the intermediate transform image V2 is deep, a left-eye image 14Lshows a see-through image as the forward part of image seems to bebigger and the backward part of image seems to become smaller in thedirection of depth.

The transform parameter r₁₁ to r₃₃ used in the equation (1) rotates theinput image V1 in the three-dimensional space of x-, y-, and z-axes. Theparameter l_(x), l_(y), and l_(z) moves the input image V1 in parallelin the direction of x-, y-, and z-axes. The transform parameter S0enlarges and reduces the input image V1 two-dimensionally.

Further, the transform parameter Δx, -Δx used in the equations (2) and(4) moves the intermediate transform image in parallel by the distance+Δx and -Δx.

Further, the transform parameter P_(z) used in the equation (3) is aperspective value for applying the perspective for having theintermediate transform image V3L seen through on the screen 11, and isset to the value in which the value of the following equation: ##EQU5##is the reference value; it means that the operator's eyes are at theposition of -16 on the z-axis.

The summary of the transform processes of the left-eye image 14L shownin FIG. 4(A1) can be represented by the following equations.

More specifically, noticing a first transform process step forconverting the object V1 to the intermediate transform image V2 by gainof the left-eye final transform image V5L based on the object V1, theimage of the input video signal, and a second transform process step forconverting so as to obtain the left-eye image 14L, the left-eyetransform matrix TL can be represented by the following equation:

    T.sub.L =T.sub.0 P.sub.L                                   (6)

which multiplies the transform matrix T₀ according to the equation (1)by the transform matrix T_(L) showing the transform process thereafter.

Here, the transform matrix P_(L) used at the second transform processstep is a perspective transform matrix as shown in the followingequation:

    P.sub.L =LP.sub.0 L.sup.-1                                 (7)

By substituting the equations (2), (3), and (4) into the equation (7),the following equation: ##EQU6## can be expressed.

Here, by substituting the equations (1) and (8) into the equation (6),the left-eye transform matrix T_(L) can be expressed as follows:##EQU7##

Incidentally in the transform matrix T_(L) represented by the equation(9), after the image data is captured in the frame memory, the inputvideo signal actually executes the transform process by the parameterconsisting the matrix. However, since both the data read out from theframe memory and the image data displayed on the screen 11 aretwo-dimensional data, arithmetic operation for two-dimensional addressdoes not need the parameters in the third line and third column of theequation (9).

Consequently, the transform matrix T_(L33) represented by the followingequation which omits the third line and the third column from theequation (9): ##EQU8## is used as the matrix for converting the positionvector x, y! on the frame memory to the position vector X_(s), Y_(s) !on the screen 11.

Here, the transform matrixes of four lines by four columns as shown inthe equations (1) to (4) represent different dimensional conversion asthe rotary transform and enlargement/reduction in the same coordinatesystem, which makes the matrix of 4×4; this is generally calledHomogeneous Coordinate.

When the two-dimensional position vector x, y! on the frame memory andthe two-dimensional position vector X_(s), Y_(s) ! on the screen 11 arerepresented in the Homogeneous Coordinate, x, y! can be represented tox, y, H! and X_(s), Y_(s) ! can be represented to X_(s), Y_(s), 1!. H isthe value showing an image enlargement ratio transformed by theperspective, which is proportioned to the value of the position vectorin the direction of z-axis.

Operation of the transform matrix T_(L33) to the position vector x, y,H! on the frame memory can obtains the vector X_(s), Y_(s), 1!. Theobtained vector on the screen 11 is defined as follows:

     X.sub.s Y.sub.s 1!= xyH!T.sub.L33                         (11)

In this embodiment, however, when the spatial image transform isexecuted, an address on the frame memory is specified to a screenaddress supplied sequentially corresponding to raster scanning asthree-dimensional transform at the time of reading out the input datafrom the frame memory.

More specifically, as shown in FIG. 5, when the inverse arithmeticoperation as follows:

     xyH!= X.sub.s Y.sub.s 1!T.sub.L33.sup.-1                  (12)

is executed, the designation of the position vector x, y, H! of thecorresponding frame memory is made corresponding to sequentialdesignation of the position vector X_(s), Y_(s), 1! on the screen 11according to the raster scanning. Therefore, supply of the positionvector x, y, H! as the two-dimensional read-out address to the framememory and the key memory provides the two-dimensional video data andkey signal to which spatial image transform is executed.

The inverse transform matrix T_(L33) ⁻¹ of the equation (12) can beobtained as follows.

First, each element of the transform matrix T_(L33) is set as parametersa₁₁ to a₃₃ as follows: ##EQU9##

Also, the parameters of the inverse matrix T_(L33) ⁻¹ are represented asparameters b₁₁ to b₃₃ as follows: ##EQU10##

Substitution the equation (14) into the equation (12) can represent thefollowing equation: ##EQU11##

Above equation can be expanded to: ##EQU12##

The following equations are thus derived from the equation (16):

    x=b.sub.11 X.sub.s +b.sub.12 Y.sub.s +b.sub.13             (17)

    y=b.sub.21 X.sub.s +b.sub.22 Y.sub.s +b.sub.23             (18)

    H=b.sub.31 X.sub.s +b.sub.32 Y.sub.s +b.sub.33             (19)

by which the value of each element of the position vector (x, y, H) onthe frame memory can be obtained.

The position vector x, y, H! on the frame memory, however, is on theHomogeneous Coordinate. Normalization of the coordinate values x, y bythe parameter H can restore it to the two-dimensional coordinate system.

Accordingly, the address X_(Lm), Y_(Lm) ! on the frame memory can beobtained as follows: ##EQU13##

The data of the pixels corresponding to the screen address (X_(s),Y_(s)) thus can be read out sequentially from the frame memory and thekey information memory by using the address data X_(LM) and Y_(rLM).

In the equations (20) and (21), the values of B₁₁ to b₃₃ are obtained asfollows from the equation (14): ##EQU14##

Provided that, it is:

    W.sub.1 =-a.sub.22 a.sub.31 a.sub.13 +a.sub.21 a.sub.32 a.sub.13 +a.sub.12 a.sub.31 a.sub.23 -a.sub.11 a.sub.32 a.sub.23 -a.sub.12 a.sub.21 a.sub.33 +a.sub.11 a.sub.22 a.sub.33                               (31)

Here, the values of a₁₁ to a₃₃ are obtained as follows from the equation(13):

    a.sub.11 =r.sub.11 -r.sub.13 P.sub.z Δx, a.sub.12 =r.sub.12, a.sub.13 =r.sub.13 P.sub.z                                         (32)

    a.sub.21 =r.sub.21 -r.sub.23 P.sub.z Δx, a.sub.22 =r.sub.22, a.sub.23 =r.sub.23 P.sub.z                                         (33)

    a.sub.31 =l.sub.x -l.sub.z P.sub.z Δx, a.sub.32 =l.sub.y, a.sub.33 =l.sub.z P.sub.z +S.sub.0                                 (34)

Thus, substitution of the above values into the equations (22) to (31)can expresses the following equations: ##EQU15## by using the parametersset by the operator in the transform matrixes represented in theequations (1) to (4).

Thus substitution of the values obtained in the equations (35) to (44)into the equations (20) and (21) supplies the read-out address (X_(LM),Y_(LM)) as follows to the frame memory: ##EQU16##

Here, it is as follows: ##EQU17##

The processes described above are the arithmetic operations for theleft-eye image transform to the object V1 shown in FIG. 4(A1). Thearithmetic operations for the right-eye image transform is also executedcorresponding to the arithmetic operations for the left-eye imagetransform as shown in FIG. 4(A2).

More specifically, the three-dimensional transform matrix T₀ moves theobject V1 input as an image of the input video signal at the origin ofx-y plane on the screen 11 in parallel in the depth direction on z-axis,and then rotates it to convert to an intermediate transform image V2.

Then, as the transform process for representing the visual difference ofthe right eye to the intermediate transform image V2, parallel movementby -Δx movement matrix L⁻¹ represented by the equation (4) in theparallel direction of x-axis by the distance of -Δx converts theintermediate transform image V2 to an intermediate transform image V3.

Then, transform of the intermediate transform image V3R by thesee-through matrix P₀ represented by the equation (3) provides anintermediate transform image V4R in which the intermediate transformimage V3R has been seen through on the screen 11. The intermediatetransform image V4R means that, when being at the position 12RX on thez-axis, the right eye 12R obtains the image V4R in which theintermediate transform image V2 is seen through on the screen 11 in thedirection of the right eye 12R.

Being converted by the movement matrix L which is represented by theequation (2), the intermediate transform image V4R is moved in parallelin the direction of x-axis by the distance of +Δx, and then is convertedto an final intermediate transform image V5R.

This right-eye final intermediate image V5R is the image in which theintermediate transform image V2 has seen through on the screen 11 in theoriginal direction of the right eye 12R when the right eye 12R at theoriginal position shifted from the center on the z-axis (the centerbetween the left eye 12L and the right eye 12R) in right direction by Δxsees the intermediate transform image V2.

The operator can thus see the right-eye final transform image V5R as thedeep right-eye image 14R on the x-y plane executed the process based onthe perspective, in which the front image portion is bigger and theimage portion in depth direction becomes smaller.

The transform process for converting the object V1 based on the inputvideo signal to the right-eye final transform image V5R, as shown inFIG. 4(B1), is executed as follows similarly to the left-eye transformprocess.

More specifically, the following transform matrix T_(R) on thearithmetic operation for the right eye is as follows:

    T.sub.R -T.sub.0 P.sub.R                                   (48)

which can be regarded that there are two parts; the three-dimensionaltransform matrix T₀ which moves and rotary converts the object V1 onz-axis, and the transform matrix P_(R) which executes the transformprocess thereafter. The right-eye transform matrix P_(R) is representedby the -Δx parallel movement matrix L⁻¹ of the equation (4), thesee-through matrix P₀ of the equation (3), and +Δx movement matrix L ofthe equation (2) as follows:

    P.sub.R =L.sup.-1 P.sub.0 L                                (49)

Substitution of the equations (4), (3) and (2) into the equation (49)realizes the expansion as follows: ##EQU18##

If the equation (50) is substituted into the equation (48), thetransform matrix P_(R) for executing the right-eye spatial imagetransform can be expanded as follows: ##EQU19##

In order to obtain significant information of only the x-y plane, theright-eye transform matrix T_(R33) which is represented by omission ofthe third line and third column of the equation (51) as the followingequation: ##EQU20## is used.

Also the right-eye transform process can obtain the vector X_(s) Y_(s)1! on the screen 11 by operating the transform matrix T_(R33) to theposition vector x y H! on the frame memory as mentioned above withregard to FIG. 5. The vector on the screen 11 thus defined by thefollowing equation:

     X.sub.s Y.sub.s 1!= xyH!T.sub.R33                         (53)

Then, in order to obtain the read-out address used for reading out videodata from the frame memory, the above equation is inversely calculatedas follows:

     xyH!= X.sub.s Y.sub.s 1!T.sub.L33.sup.-1                  (54)

This enables to specify the position vector x y H! of the frame memorycorresponding to the position vector X_(s) Y_(s) 1! on the screen 11when the position vector X_(s) Y_(s) 1! is specified according to rasterscanning. It is thus possible to obtain the two-dimensional video dataand key signal spatially converted the image.

Here, in order to obtain the inverse transform matrix T_(L33) ⁻¹, theparameters a₁₁ to a₃₃ and b₁₁ to b₃₃ are set as elements for thetransform matrix T_(R33) and the inverse transform matrix T_(R33) ⁻¹ asfollows: ##EQU21##

Those equations permits to obtain the parameters b₁₁ to b₃₃ as follows:##EQU22## here, it is as follows:

    W.sub.1 =-a.sub.22 a.sub.31 a.sub.13 +a.sub.21 a.sub.32 a.sub.13 +a.sub.12 a.sub.31 a.sub.23 -a.sub.11 a.sub.32 a.sub.23 -a.sub.12 a.sub.21 a.sub.33 +a.sub.11 a.sub.22 a.sub.33                               (66)

The parameters a₁₁ to a₃₃ are obtained from the equation (55) asfollows:

    a.sub.11 =r.sub.11 +r.sub.13 P.sub.z Δx, a.sub.12 =r.sub.12, a.sub.13 =r.sub.13 P.sub.z                                         (67)

    a.sub.21 =r.sub.21 +r.sub.23 P.sub.z Δx, a.sub.22 =r.sub.22, a.sub.23 =r.sub.23 P.sub.z                                         (68)

    a.sub.31 =l.sub.x +l.sub.z P.sub.z 66 x, a.sub.32 =l.sub.y, a.sub.33 =l.sub.z P.sub.z +S.sub.0                                 (69)

By substituting those equations into the equations (57) to (66) asfollows: ##EQU23## the values of each element in the matrix can berepresented by the parameter in which the operator sets as the transformcondition as the equations (1) to (4).

Incidentally, same manner as the above-mentioned equations (15) to (21)can be applied to the right-eye transform arithmetic operation.Substitution of relation of the equation (54) into the equation (56) canrepresent the following equation: ##EQU24## which shows the positionvector x y H! by the position vector X_(s) Y_(s) 1! and the parametersb₁₁ to b₁₃. Then, expansion of this equation as follows: ##EQU25## candeduce the position vector x y H! on the frame memory as follows:

    x=b.sub.11 X.sub.s +b.sub.12 Y.sub.s +b.sub.13             (82)

    y=b.sub.21 X.sub.s +b.sub.22 Y.sub.s +b.sub.23             (83)

    H=b.sub.31 X.sub.s +b.sub.32 Y.sub.s +b.sub.33             (84)

Since the position vector x y H! on the frame memory is the homogeneouscoordinate, normalization by the parameter H can deduce the address(X_(Rm) Y_(Rm)) on the frame memory as follows: ##EQU26##

Then, by substituting the equations (70) to (79) into the equations (85)and (86), the read-out address (X_(Rm) Y_(Rm)) to the frame memory canbe set as follows: ##EQU27##

Here, it is as follows: ##EQU28##

According to the stereoscopic image generation method described above,the intermediate transform images V3L and V3R both of which the objectV1 shown by the input video signal is moved and rotated in the depthdirection and also moved in Δx and -Δx directions are seen through onthe screen 11 in the direction along the operators' left eye 12L andright eye 12R. Thereby the final transform images V5L and V5R to beprojected can be obtained by visual difference between the left eye 12Land the right eye 12R. This enables to generate the deep image of theobject on the screen, or backward the screen, or front in the screenbased on the visual difference between the left eye 12L and the righteye 12R.

Then, the operator inputs each parameter of the three-dimensionaltransform matrix T₀ defined by the equation (1), +Δx movement matrix Ldefined by the equation (2), the see-through matrix P₀ defined by theequation (3), and -Δx movement matrix L⁻¹ defined by the equation (4),so that it is possible to generate stereoscopic image having arbitrarytransform correspondence at arbitrary position as necessary.

According to the processes described above, it is possible toarbitrarily select the parameters in which the operator can set such asr₁₁ to r₃₃ representing spatial rotation of the converted image, l_(x),l_(y) and l_(z) representing parallel movements in the directions of x,y and z-axes, S₀ representing two-dimensional expansion/reduction, P_(z)representing the perspective value based on the perspective, and thevalue Δx representing a half of distance between the left eye 12L andthe right eye 12R if the occasion demand. The image to be generated thuscan be specified easily.

Further, the image data representing the image of the input video signalis written in and its read-out address is specified corresponding to theraster scan address on the screen. This enables to generate the left-eyeand right-eye final transform images V5L and V5R on the screen 11 at thesame time.

(2) First Embodiment of the Stereoscopic Image Generation Apparatus

In FIG. 6, 21 entirely shows a stereoscopic image generation apparatus,which receives an input video signal V_(A), an input key signal K_(A),and an input background signal V_(BK) at a left-eye processor 22L and aright-eye processor 22R, and supplies a left-eye and right-eyestereoscopic image output signals VL_(OUT) and VR_(OUt) respectivelyrepresenting the left-eye and right-eye final transform images V5L andV5R to a left-eye and right-eye projectors 23L and 23R.

This permits the left-eye and right-eye projector 23L and 23R to projectthe left-eye and right-eye final transform image V5L and V5R on a screen24 respectively.

The left-eye processor 22L and the right-eye processor 22R, and theleft-eye and right-eye projectors 23L and 23R are controlled by acentral process unit (CPU) 32 via a bus 31.

According to a program in a program memory 33 having ROM structure, theCPU 32 utilizes a working memory 34 having RAM structure to executeprocess operation of each part in the stereoscopic image generationapparatus 21.

The CPU 32 generates write-in address signals Sx and Sy representingposition vector x y! on the frame memory at a write-in addressgeneration circuit 35. The write-in address signals Sx and Sysequentially specify storing position in frame memories 36L and 36R ofthe left-eye and right-eye processors 22L and 22R so as to store theinput video signal V_(A) as left-eye and right-eye source video datasynchronizing with each other.

The write-in address signals Sx and Sy are also supplied to key signalmemories 37L and 37R of the left-eye and right-eye processors 22L and22R. This enables the key signal memories 37L and 37R to store the keydata in regard to the position vector x y! on the frame memoriessynchronizing with the input video signal V_(A).

The CPU 32 drives a screen address generation circuit 38 provided forcommon use of the left-eye and right-eye processors 22L and 22R so as togenerate the position vector X_(s) Y_(s) ! on the screen 24 based on areference signal generated from a built-in reference signal generationcircuit. These screen addresses SX_(s) and SY_(s) are supplied toread-out address generation circuits 39L and 39R of the left-eye andright-eye processors 22L and 22R.

The read-out address generation circuits 39L and 39R are under thecontrol of the CPU 32 so as to supply read-out address signal SX_(Lm),SY_(Lm) and SX_(Rm), SY_(Rm) representing read-out addresses (X_(Lm)Y_(Lm)) and (X_(Rm) Y_(Rm)), which are respectively specified by theequations (45), (46) and (87) and (88), to the frame memories 36L and36R and the key signal memories 37L and 37R.

Image data VL₁ and VR₁ read out from the frame memories 36L and 36R ofthe left-eye and right-eye processors 22L and 22R are interpolated atvideo signal interpolation circuits 40L and 40R, and then are suppliedto combiners 41L and 41R as read-out video signals VL₂ and VR₂.

At the same time, key data KL₁ and KR₁ read out from the key signalmemories 37L and 37R of the left-eye and right-eye processors 22L and22R are interpolated at the key signal interpolation circuits 40L and40R, and then are supplied to the combiners 42L and 42R as read-outvideo signal KL₂ and KR₂.

The combiners 41L and 41R are under the control of the CPU 32 so as toexecute the keying process between the read-out video signals VL₂ andVR₂ and the input background signal V_(BK) by the read-out key signalsKL₂ and KR₂. The combiners 41L and 41R consequently supply thestereoscopic image output signals VL_(out) and VR_(out) represented bythe following equations:

    VL.sub.out =KL.sub.2 VL.sub.2 +(1-KL.sub.2)V.sub.BK        (90)

    VR.sub.out =KR.sub.2 VR.sub.2 +(1-KR.sub.2)V.sub.BK        (91)

as the output from the left-eye and right-eye processors 22L and 22R tothe left-eye and right-eye projectors 23L and 23R.

The following description will be made of operation of the stereoscopicimage generation apparatus 21.

First, the operator previously inputs the values of visual differencedistance Δx and perspective value P_(z) necessary to the arithmeticoperation of the present invention via a control panel 51. The CPU 32stores the visual difference distance Δx and the perspective value P_(z)newly set by the operator in the RAM 34. Incidentally, when detecting noinput from the operator, the CPU 32 uses the reference value (Δx=3.25cm, P_(z) =-1/16) stored already in the RAM 34.

Then the operator operates a three-dimensional pointing device providedon the control panel 51 to command three-dimensional image transformoperation to source video signal. When the operator commands thethree-dimensional transform process to the source video signal, the CPU32 receives r₁₁ to r₃₃, l_(x), l_(y), l_(z) and S₀ which are parametersof matrix T₀ showing the three-dimensional transform specified by theoperator. At the same time, the CPU 32 receives the visual differencedistance Δx and the perspective value P_(z) stored in the RAM 34. Then,the CPU 32 utilizes the received parameters r₁₁ to r₃₃, l_(x), l_(y),l_(z) and S₀, Δx and P_(z) so as to calculate the parameters b₁₁ to b₃₃represented in the equations (35) to (43) and the parameters b₁₁ to b₃₃represented in the equations (70) to (78). The CPU 32 supplies thecalculated values of the parameter b₁₁ to b₃₃ to the read-out addressgeneration circuit 39L; simultaneously supplies the calculated values ofthe parameter b₁₁ to b₃₃ to the read-out address generation circuit 39R.

The read-out address generation circuit 39L generates the left-eyeread-out address (X_(Lm), Y_(Lm)) represented in the equation (20) basedon the parameters r₁₁ to r₃₃ supplied from the CPU 32 and the screenaddress (X_(s), Y_(s)) supplied from the screen address generationcircuit 38. The read-out address generation circuit 39L supplies theleft-eye read-out address (X_(Lm), Y_(Lm)) to the frame memory 36L andthe key signal memory 37L.

At the same time, the read-out address generation circuit 39R generatesthe right-eye read-out address (X_(Rm), Y_(Rm)) represented in theequation (85) based on the parameters b₁₁ to b₃₃ supplied from the CPU32 and the screen address (X_(s), Y_(s)) supplied from the screenaddress generation circuit 38. The read-out address generation circuit39R supplies the right-eye read-out address (X_(Rm), Y_(Rm)) to theframe memory 36R and the key signal memory 37R.

As described above, the transform video signal VL1 read out from theframe memory 36L represents the video signal V5L which is projected onthe screen surface when the operator sees the video signal V2 convertedin the three-dimensional space by the spatial transform matrix T₀ fromthe position of the left eye 12L, as shown in FIG. 4(A1): the transformvideo signal VR₁ read out from the frame memory 36R represents the videosignal V5R which is projected on the screen surface when the operatorsees the video signal V2 converted in the three-dimensional space by thespatial transform matrix T₀ from the position of the right eye 12R, asshown in FIG. 4(A2).

The transform video signals VL₁ and VR₁ read out from the frame memories36L and 36R are interpolated at the video signal interpolation circuits40L and 40R with peripheral pixels, and then are output as the transformvideo signals VL₂ and VR₂. The transform key signal KL₁ and KR₁ read outfrom the key signal memories 37L and 37R are similarly interpolated atthe key signal interpolation circuits 42L and 42R with peripheralpixels, and then are output as the transform key signal KL₂ and KR₂.

As described above, capture of the input information input by theoperator with the control panel 51 through an interface 52 enables theCPU 32 to provide the left-eye and right-eye projectors 23L and 23R withthe left-eye and right-eye stereoscopic image output signal VL_(out) andVR_(out), which are generated by converting the input video signal V_(A)and the input key signal K_(A) at the same time according to thecontents of image transform process specified by the operator, from theleft-eye and right-eye processors 22L and 22R.

Here, if the operator sets the parameters r₁₁ to r₃₃ with the controlpanel 51, the CPU 32 specifies what degree the object V1 should rotatespatially in regard to the three-dimensional transform matrix P₀ at theread-out address generation circuits 39L and 39R.

Further, if the operator sets the parameters l_(x), l_(y) and l_(z) withthe control panel 51, the CPU 32 specifies how far the object V1 shouldmove in parallel in the direction of x-axis, y-axis and z-axis in regardto the three-dimensional transform matrix P₀ at the read-out addressgeneration circuits 39L and 39R.

Further, if the operator sets the parameter S₀ with the control panel51, the CPU 32 specifies how large or small the object V1 should beextended or reduced on the xy plane in regard to the three-dimensionaltransform matrix P₀ at the read-out address generation circuits 39L and39R.

Further, if the operator sets the parameter Δx with the control panel51, the CPU 32 generates the read-out address signals SX_(Lm), SY_(Lm)and SX_(Rm), SY_(Rm) which regulate how far the distance Δx, the half ofthe distance between the left eye 12L and the right eye 12R, should bein regard to the +Δx movement matrix L and -Δx movement matrix L⁻¹,namely how far visual difference between the left eye 12L and the righteye 12R should be.

In this embodiment, the parameter P_(z) is structured so that the valueis input as 1/16 all the time from the control panel 51. The. CPU 32thus outputs the read-out address signal for regulating the perspectivevalue based on perspective for the see-through matrix P₀ at the read-outaddress generation circuits 39L and 39R.

The operator therefore can set the parameter Δx for regulating thevisual difference between the left eye 12L and the right eye 12R ondesired value by the control panel 51. This enables to set easily theamount of shift of the left-eye image 14L and the right-eye image 14Rconsisting of the final converted images V5L and V5R, which areprojected on the screen 24 by the left-eye and right-eye projectors 23Land 23R, on the appropriate value at will.

As described above, the read-out address generation circuits 39L and 39Rof the left-eye and right-eye processors 22L and 22R execute theirprocesses at the same time based on common screen address signals SX_(s)and SY_(s), so that the left-eye and right-eye stereoscopic image outputsignals VL_(out) and VR_(out) are generated simultaneously. Thisprovides the stereoscopic image having better picture quality.

According to the structure described above, the left-eye perspectivetransform matrix P_(L) and the right-eye perspective transform matrixP_(R) are utilized in the arithmetic operation of the left-eye videosignal and the right-eye video signal in which the transform videosignal converted to the spatial position by moving and rotating thesource video signal V1 in the three-dimensional space is projected onthe xy-plane from the position of the left eye 12L and the position ofthe right eye 12R respectively. The appropriate video signal accordingto the visual difference between the left eye and the right eyetherefore can be generated.

Further, it is possible to generate the left-eye video signal and theright-eye video signal both of which have the visual differenceaccording to the spatial position of the converted video signal V2. Inother words, such arithmetic operation is executed as the more thesource video signal is converted to the position of the depth direction(direction of +z) three-dimensionally to the screen, the more theleft-eye video signal shifts to left and the right-eye video signalshifts to right. Further, such arithmetic operation is also executed asthe source video signal is converted to the position of the frontdirection (direction of -z) three-dimensionally to the screen incontrast with the above, the more the left-eye video signal shifts toright and the right-eye video signal shifts to left. This enables togenerate stereoscopic video signal easily.

(3) The Second Embodiment of the Stereoscopic Image Generation Apparatus

FIG. 7 shows the second embodiment of the present invention in which thesame number is applied to the corresponding part of the stereoscopicimage generation apparatus 61 in FIG. 6. The left-eye and right-eyestereoscopic image output signals VL_(OUT) and VR_(OUR) obtained fromleft-eye and right-eye projectors 62L and 62R are output to the left-eyeand right-eye projectors 23L and 23R respectively and recorded inleft-eye and right-eye video signal recording devices 63L and 63Rconsisting of, for example, video tape recorders.

The left-eye and right-eye video signal recording devices 63L and 63Rare controlled by the CPU 32 so as to reproduce the recorded videosignal as left-eye and right-eye feedback video signals VBL and VBR andfeedback them to the frame memories 36L and 36R of the left-eye andright-eye processors 62L and 62R as image input signals VL₀ and VR₀through switching input terminal W2 of switches 64L and 64R.

In this embodiment, the input video signal V_(A) is input to the framememories 36L and 36R as input video signals WL₀ and WR₀ through twofirst switch terminals W1 of the left-eye and right-eye switches 64L and64R both of which execute switching operations controlled by the CPU 32.

The input video signals VL₀ and VR₀ input through the left-eye andright-eye switches 64L and 64R are also input to key signal generationcircuits 65L and 65R of the left-eye and right-eye processors 62L and62R. Thus the CPU 32 controls to input key signals KL₀ and KR₀ capableof keying process synchronized with the input video signals VL₀ and VR₀from the key signal generation circuits 65L and 65R both of whichexecute the key signal generation operations to the key signal memories37L and 37R.

With the structure of FIG. 7, as shown in FIGS. 8(A) and 8(B), the firstleft-eye and right-eye images 70L and 70R out of images projected on thescreen 24 from the left-eye and right-eye projectors 23L and 23R areprojected on part of the screen 24, for instance the left part, and thesecond left-eye and right-eye images 72L and 72R are projected on theother part of the screen 24, for instance the right part.

The first left-eye and right-eye images 70L and 70R convert the imagerepresented by the input video signal V_(A) with the image transformmethod described above referring to FIGS. 4(A1) to (B2).

In this embodiment, the operator recognizes the first left-eye andright-eye images 70L and 70R as a stereoscopic image 71 formed based onthe input video signal V_(A) by seeing virtual image with the operator'sleft and right eyes 12L and 12R.

On the other hand, the second left-eye and right-eye images 72L and 72Rprojected on the right part of the screen 24 are such images as theimages represented by the left-eye and right-eye feedback video signalsVBL and VBR reproduced from the left-eye and right-eye video signalrecording devices 63L and 63R are read out from the frame memories 36Land 36R with the read-out address signals SX_(Lm), SY_(Lm) and SX_(Rm),SY_(Rm), which are executed the image transform process with the imagetransform method described above according to FIGS. 4(A1) to 4(B2), andthen projected on the screen 24.

In the case of FIG. 8(A), the operator's left eye 12L and right eye 12Rtoward the second left-eye and right-eye images 72L and 72R intersectswith each other in front of the screen 24. This enables the operator torecognize a stereoscopic image 73 formed by the left-eye and right-eyefeedback video signals VBL and VBR in the virtual space in front of thescreen 24.

With the structure shown in FIG. 7, the left-eye and right-eye switches64L and 64R are controlled by the CPU 32 so as to let the video signalV_(A) through the first switch input terminals W1 at the timing of leftportion out of the image section for one frame. The video signal V_(A)is then stored in the left memory area of the left-eye and right-eyeframe memories 36L and 36R.

On the other hand, the left-eye and right-eye switches 64L and 64Rswitch to the second switch input terminals W2 in the term of leftportion out of the term for one frame, so that the left-eye andright-eye feedback video signals VBL and VBR are stored in the framememories 36L and 36R.

As a result, the image data for one frame including two video data isstored in the frame memories 36L and 36R, and the read-out addresssignal is generated by being executed the image transform process at theread-out address generation circuits 39L and 39R under the control ofthe CPU 32. Thus the left-eye and right-eye stereoscopic image outputsignals VL_(out) and VR_(out) consisting of the image for one framerepresenting the first left-eye and right-eye video signals 70L and 70Rand the second left-eye and right-eye images 72L and 72R are output tothe projectors 23L and 23R.

The left-eye and right-eye stereoscopic image output signals VL_(out)and VR_(out) representing the image for one frame to which the imagetransform process is executed are stored in the left-eye and right-eyevideo signal recording devices 63L and 63R, and then only the videosignals of the second left-eye and right-eye images 72L and 72R arestored as the left-eye and right-eye switches 64L and 64R in the framememories 36L and 36R through the left-eye and right-eye switches 24L and24R.

Here, if the input video signal V_(A) is exactly the same as it hasbeen, only the second left-eye and right-eye images 72L and 72R out ofthe image data for one frame stored in the frame memories 36L and 36Rare changed with the image transform process at the read-out addressgeneration circuits 39L and 39R.

In this state, if the read-out address generation circuits 39L and 39Rare controlled by the CPU 32 s0 as to execute again the image transformprocess, only the second left-eye and right-eye images 72L and 72R areexecuted the image transform process shown in FIGS. 4(A1) to 4(B2), andthen output to the projectors 23L and 23R as the left-eye and right-eyestereoscopic image output signals VL_(out) and VR_(out).

The image transform process is executed time and again on the secondleft-eye and right-eye images 72L and 72R projected on the right part ofthe screen 24 by the projectors 23L and 23R, so that the stereoscopicimage 73 formed by the feedback video signals VBL and VBR is changingsequentially in every frame. On the contrary, the stereoscopic image 71formed by the first left-eye and right-eye images 70L and 70R which arebased on the input video signal V_(A) with no change in its contentsdoes not change. Therefore the operator recognizes it as the fixedimage.

As described above, according to the structure shown in FIG. 7, only thedesired part of the stereoscopic image generated on the screen 24 can befed back as the left-eye and right-eye feedback video signals VBL andVBR to the frame memories 36L and 36R. It is thus possible to easilygenerate the stereoscopic image as if a part of the stereoscopic imageis changing by the image transform process repeatedly executed.

(4) The Other Embodiments

In the embodiments described above, previous fixation of the parameterP_(z) in the equation (3) for the see-through matrix P₀ to 1/16 keepsthe perspective value based on the perspective. However, the presentinvention is not only limited to this, but if the parameter P_(z) ischangeable according to the operation with the control panel 51 by theoperator, the same effect as the above-mentioned embodiment can beobtained.

Further, in the above-mentioned embodiment of FIG. 7, feedback of a partof image projected on the screen 24 to the frame memories 36L and 36Renables to repeatedly execute the image transform process on the part ofimage. However, the present invention is not only limited to this, butthe image transform process can be repeatedly executed on entire imagegenerated on the screen 24.

Further, in the embodiment described above, projection of the left-eyeand right-eye stereoscopic image output signals VL_(out) and VR_(out) onthe screen 24 by the left-eye and right-eye projectors 23L and 23Rgenerates the stereoscopic image. However, display means of stereoscopicimage is not only limited to this, but the other type of imagedisplaying apparatus, for example a head-mounted type image apparatus,can be utilized.

Further, in the above-mentioned embodiment of FIG. 7, video taperecorders are utilized in the left-eye and right-eye video signalrecording devices. However, the video signal recording apparatus is notonly limited to this, but the other image recording devices can beutilized such as a video disc device or a semiconductor memory devices.

Industrial Applicability

The present invention can be applied to a stereoscopic image generationapparatus which generates stereoscopic image by using video signalrepresenting two-dimensional image.

We claim:
 1. A stereoscopic image generation apparatus for generatingvideo signal in order to obtain stereoscopic effects visually,comprising:a left-eye processor for generating left-eye stereoscopicvideo signal from source video signal based on a spatial image transformmatrix for image transform which converts an image represented by saidsource video signal to virtual spatial position, and a left-eyeperspective transform matrix for having a converted image represented bythe converted transform video signal seen through on a screen; and aright-eye processor for generating right-eye stereoscopic video signalfrom said source video signal based on said spatial image transformmatrix and a right-eye perspective transform matrix for having aconverted image represented by said transform video signal seen throughon the screen, wherein:said spatial image transform matrix T₀ is definedas follows: ##EQU29## said left-eye perspective transform matrix P_(L)is defined as follows: ##EQU30## said right-eye perspective transformmatrix P_(R) is defined as follows: ##EQU31## provided that, r₁₁ to r₃₃are the parameters representing spatial rotary transform; l_(x) is theparameter representing parallel movement in the direction of x-axis;l_(y) is the parameter representing parallel movement in the directionof y-axis; l_(z) is the parameter representing parallel movement in thedirection of z-axis; S_(o) is the parameter representing two-dimensionalextension and reduction; P_(z) is the perspective value previously set;and Δx is the value representing a half of distance between theright-eye and left-eye.
 2. The stereoscopic image generation apparatusaccording to claim 1, wherein:said left-eye perspective conversionmatrix P_(L) is obtained as follows;

    P.sub.L =LP.sub.0 L.sup.-1

said right-eye perspective conversion matrix P_(R) is obtained asfollows;

    P.sub.R =L.sup.-1 LP.sub.0

provided that, the matrix L is defined as follows; ##EQU32## the matrixL⁻¹ is defined as follows; ##EQU33## and the matrix P₀ is defined asfollows; ##EQU34##
 3. The stereoscopic image generation apparatusaccording to claim 2, wherein: said left-eye processor comprisesfirststoring means for storing said source video signal temporarily; andfirst read-out address generation means for generating read-out address,which is calculated based on said spatial image transform matrix andsaid left-eye perspective transform matrix, for reading out the videosignal stored in said first storing means; said right-eye processorcomprisessecond storing means for storing said source video signaltemporarily; and second read-out address generation means for generatingread-out address, which is calculated based on said spatial transformmatrix and said right-eye perspective transform matrix, for reading outthe video signal stored in said second storing means.
 4. Thestereoscopic image generation apparatus according to claim 3,wherein:read-out address (X_(Lm), Y_(Lm)) supplied to said first storingmeans are as follows; ##EQU35## provided that, the definition will bemade by the following equation; ##EQU36## read-out address (X_(Rm),Y_(Rm)) supplied to said second storing means are; ##EQU37## providedthat, the definition will be made as follows; ##EQU38## and, X_(s) andY_(s) are screen addresses corresponding to the raster scanning.
 5. Thestereoscopic image generation apparatus according to claim 4,whereinsaid same screen addresses are sequentially supplied to both ofsaid first read-out address generation means and said second read-outaddress generation means.
 6. The stereoscopic image generation apparatusaccording to claim 3, comprising:write-in address generation means forgenerating write-in address for writing said source video signal in saidfirst storing means and said second storing means, and wherein: the samewrite-in addresses are supplied from said write-in address generationmeans to said first storing means and said second storing means,respectively.
 7. A stereoscopic image generation apparatus forgenerating video signal in order to obtain stereoscopic effectsvisually, comprising:a left-eye processor for generating left-eyestereoscopic video signal from source video signal based on a spatialimage transform matrix for image transform which converts an imagerepresented by said source video signal to virtual spatial position, anda left-eye perspective transform matrix for having a converted imagerepresented by the converted transform video signal seen through on ascreen; and a right-eye processor for generating right-eye stereoscopicvideo signal from said source video signal based on said spatial imagetransform matrix and a right-eye perspective transform matrix for havinga converted image represented by said transform video signal seenthrough on the screen, further comprising:a first recording/reproducingdevice for recording the output video signal output from said left-eyeprocessor to a recording medium and for reproducing the recorded videosignal from the recording medium; a second recording/reproducing devicefor recording the output video signal output from said right-eyeprocessor to a recording medium and for reproducing the recorded videosignal from the recording medium; first key signal generation means forgenerating key signal from the first reproduced video signal reproducedfrom said first recording/reproducing device; second key signalgeneration means for generating key signal from the second reproducedvideo signal reproduced from said second recording/reproducing device,and wherein:said left-eye processor receives the first reproduced videosignal reproduced from said first recording/reproducing device, the keysignal generated by said first key signal generation means, andbackground video signal used for the background of said source videosignal; executes first spatial image conversion to said first reproducedvideo signal and the same spatial image transform as said first spatialimage transform to said key signal based on said spatial image transformmatrix and said left-eye perspective transform matrix; and compositesthe video signal converted by said first image transform means with saidbackground video signal based on the key signal converted by said firstimage transform means; and said right-eye processor receives the secondreproduced video signal reproduced from said secondrecording/reproducing device, the key signal generated by said secondkey signal generation means, and said background video signal; executesthe second spatial image transform to said second reproduced videosignal and the same spatial image transform as said second spatial imagetransform to said key signal based on said spatial image transformmatrix and said right-eye perspective transform matrix; and compositesthe video signal converted by said second image transform means withsaid background video signal based on the key signal converted by saidsecond image transform means.
 8. The stereoscopic image generationapparatus according to claim 7, whereinthe key signal generated by saidfirst key signal generation means is the same signal as the key signalgenerated by said second key signal generation means.
 9. A video signalgeneration apparatus for generating video signal for visual stereoscopiceffects, comprising:image transform means for converting an imagerepresented by source video signal to a virtual spatial position;left-eye video signal generation means for generating left-eye videosignal representing an image seen trough on a screen surface based onthe virtual spatial position where there is the image of the convertedvideo signal converted by said image transform means and left-eyespatial position; and right-eye video signal generation means forgenerating right-eye video signal representing an image seen through ona screen surface based on the virtual spatial position where there isthe image of said converted video signal and right-eye spatial position,wherein:said image transform means converts said source video signalbased on spatial image transform matrix; said left-eye video signalgeneration means generates said left-eye video signal based on left-eyeperspective transform matrix; and said right-eye video signal generationmeans generates said right-eye video signal based on right-eyeperspective transform matrix, wherein:said spatial image transformmatrix T₀ is defined as follows: ##EQU39## said left-eye perspectivetransform matrix P_(L) is defined as follows: ##EQU40## said right-eyeperspective transform matrix P_(R) is defined as follows: ##EQU41##provided that, r₁₁ to r₃₃ are parameters representing spatial rotarytransform; l_(x) is the parameter representing parallel movement in thedirection of x-axis; l_(y) is the parameter representing parallelmovement in the direction of y-axis; l_(z) is the parameter representingparallel movement in the direction of z-axis; S_(o) is the parameterrepresenting two-dimensional extension and reduction; and Δx is a valueshowing a half of distance of a right eye and a left-eye.
 10. The videosignal generation apparatus according to claim 9, wherein:said left-eyeperspective transform matrix P_(L) is obtained as follows;

    P.sub.L =LP.sub.0 L.sup.-1

said right-eye perspective transform matrix P_(R) is obtained asfollows;

    P.sub.R =L.sup.31 1 LP.sub.0

proveded that, the matrix L is defined as follows; ##EQU42## the matrixL⁻¹ is defined as follows; ##EQU43## and the matrix P₀ is defined asfollows: ##EQU44##
 11. The video signal generation apparatus accordingto claim 10, wherein: said left-eye video signal generation meanscomprisesfirst storing means for storing said source video signaltemporarily; and first read-out address generation means for generatingread-out address for reading out the video signal which is calculatedbased on said spatial image transform matrix and said left-eyeperspective transform matrix and is stored in said first storing means;said right-eye video signal generation means comprisessecond storingmeans for storing said source video signal temporarily; and secondread-out address generation means for generating read-out address forreading out the video signal which is calculated based on said spatialimage transform matrix and said right-eye perspective transform matrixand is stored in said second storing means.
 12. The video signalgeneration apparatus according to claim 11, wherein:the read-out address(X_(Lm), Y_(Lm)) supplied to said first storing means is as follows;##EQU45## provided that, definition is done as follows; ##EQU46## theread-out address (X_(Rm), Y_(Rm)) supplied to said second storing meansis as follows; ##EQU47## provided that, definition is done as follows:##EQU48## and provided that, X_(s) and Y_(s) are screen addresses. 13.The video signal generation apparatus according to claim 12, whereinthesame screen addresses are sequentially supplied to both said firstread-out address generation means and said second read-out addressgeneration means corresponding to raster scanning.
 14. The video signalgeneration apparatus according to claim 11, comprising:write-in addressgeneration means for generating write-in address for writing said sourcevideo signal in said first storing means and said second storing means,and wherein: same write-in address is supplied from said write-inaddress generation means to the write-in address supplied to said firststoring means and said second storing means.
 15. A video signalgeneration apparatus for generating video signal for visual stereoscopiceffects, comprising:image transform means for converting an imagerepresented by source video signal to a virtual spatial position;left-eye video signal generation means for generating left-eye videosignal representing an image seen trough on a screen surface based onthe virtual spatial position where there is the image of the convertedvideo signal converted by said image transform means and left-eyespatial position; and right-eye video signal generation means forgenerating right-eye video signal representing an image seen through ona screen surface based on the virtual spatial position where there isthe image of said converted video signal and right-eye spatial position,wherein:said image transform means converts said source video signalbased on spatial image transform matrix; said left-eye video signalgeneration means generates said left-eye video signal based on left-eyeperspective transform matrix; and said right-eye video signal generationmeans generates said right-eye video signal based on right-eyeperspective transform matrix, comprising:first recording/reproducingdevice for recording output video signal output from said left-eye videosignal generation means to a recording medium and for reproducing therecorded video signal from the recording medium; secondrecording/reproducing device for recording output video signal outputfrom said right-eye video signal generation means to a recording mediumand for reproducing the recorded video signal from the recording medium;first key signal generation means for generating key signal from thefirst reproduced video signal reproduced from said firstrecording/reproducing device; and second key signal generation means forgenerating key signal from the second reproduced video signal reproducedfrom said second recording/reproducing device, wherein:said left-eyevideo signal generation means receives the first reproduced video signalreproduced from said first recording/reproducing device, the key signalgenerated by said first key signal generation means, and backgroundvideo signal used for the background of said source video signal;executes first spatial image transform to said first reproduced videosignal and the same spatial image transform as said first spatial imagetransform to said key signal based on said spatial image transformmatrix and said left-eye perspective transition matrix; and compositesthe video signal converted by said first image transform means with saidbackground video signal based on the key signal converted by said firstimage transform means; wherein said right-eye processor receives thesecond reproduced video signal reproduced from said secondrecording/reproducing device, the key signal generated by said secondkey signal generation means and said background video signal; executessecond spatial image transform to said second reproduced video signaland the same spatial image transform as said second spatial imagetransform to said key signal based on said spatial image transformmatrix and said right-eye perspective transform matrix; and compositesthe video signal converted by said second image transform means withsaid background video signal based on the key signal converted by saidsecond image transform means.
 16. The video signal generation apparatusaccording to claim 15, whereinthe key signal generated by said first keysignal generation means is the same key signal as the key signalgenerated by said second key signal generation means.
 17. A video signalgeneration method for generating video signal for obtaining the virtualstereoscopic effects, comprising:(a) first step of converting sourcevideo signal to virtual spatial position; (b) second step of generatingleft-eye video signal seen through on a screen surface based on thevirtual spatial position of the converted video signal converted at saidfirst step and spatial position of the left eye; and (c) third step ofgenerating right-eye video signal seen through on a screen surface basedon the virtual spatial position of the converted video signal convertedat said first step and spatial position of the right eye, wherein:saidsource video signal is converted at said first step based on spatialimage transform matrix having parameters corresponding to spatialtransform operation which the operator desires; said left-eye videosignal is generated at said second step based on left-eye perspectivetransform matrix having parameters previously set by the operator; andsaid right-eye video signal is generated at said third step based onright-eye perspective transform matrix having parameters previously setby the operator, whereinsaid spatial image transform matrix T₀ isdefined as follows: ##EQU49## said left-eye perspective transform matrixP_(L) is defined as follows: ##EQU50## said right-eye perspectivetransform matrix P_(R) is defined as follows: ##EQU51## provided that,r₁₁ to r₃₃ are the parameters representing spatial rotary transform;l_(x) is the parameter representing parallel movement in the directionof x-axis; l_(y) is the parameter representing parallel movement in thedirection of y-axis; l_(z) is the parameter representing parallelmovement in the direction of z-axis; S_(o) is the parameter representingtwo-dimensional extension and reduction; P_(z) is the perspective valuepreviously set; and Δx is the value representing a half of distancebetween the right-eye and left-eye.
 18. The video signal generationapparatus according to claim 17, wherein:said left-eye perspectivetransform matrix P_(L) is obtained as follows:

    P.sub.L =LP.sub.0 L.sup.-1

said right-eye perspective transform matrix P_(R) is obtained asfollows:

    P.sub.R =L.sup.-1 LP.sub.0

provided that, the matrix L is defined as follows; ##EQU52## the matrixL⁻¹ is defined as follows; ##EQU53## and the matrix P₀ is defined asfollows; ##EQU54##
 19. The video signal generation method according toclaim 18, further comprising the steps of: temporarily storing saidsource video signal to first storing means and second storingmeans;generating left-eye read-out address for reading out the videosignal stored in said first storing means based on said spatial imagetransform matrix and said left-eye perspective transform matrix; andgenerating right-eye read-out address for reading out the video signalstored in said second storing means based on said spatial imagetransform matrix and said right-eye perspective transform matrix. 20.The video signal generation method according to claim 19, wherein:saidleft-eye read-out address (X_(Lm), Y_(Lm)) are; ##EQU55## provided that;##EQU56## said right-eye read-out address (X_(Rm), Y_(Rm)) are asfollows; ##EQU57## provided that, it is defined as follows; ##EQU58##and, X_(s) and Y_(s) are screen addresses corresponding to the rasterscanning.